Heygem is an open-source alternative to HeyGen, offering precise cloning of appearance and voice, and supporting lip-sync for realistic video generation.

On March 6th, Mobvoi collaborated with leading academic institutions including the Hong Kong University of Science and Technology, Shanghai Jiao Tong University, Nanyang Technological University, and Northwestern Polytechnical University to open-source Spark-TTS, a new generation of speech synthesis model. Simultaneously, they launched TicVoice 7.0, a high-quality commercial TTS engine. As Mobvoi's seventh-generation TTS engine, TicVoice 7.0 represents a significant breakthrough in speech synthesis, ushering in a new paradigm for voice generation.

Lei Jun pointed out that AI terminals, as important platforms for the implementation of AI technology, are constantly expanding their application scope, extending from smartphones, smart cars, and wearable devices to smart homes and robots. This trend not only injects new vitality into the consumer market but also provides key impetus for the high-end and intelligent upgrading of the industrial chain. However, in the early stages of the rapid development of AI terminals, it is still necessary to overcome core technological bottlenecks, build a collaborative innovation ecosystem, and promote industry standardization, collaboration, innovation, and high-quality development.

Artificial intelligence voice company ElevenLabs has once again captured attention, having just completed a Series C funding round totaling $250 million, with a valuation between $3 billion and $3.3 billion. This round was led by ICONIQ Growth, demonstrating strong market confidence in AI voice technology. Just a year ago, ElevenLabs completed an $80 million Series B funding, when its valuation was only a third of what it is now, highlighting the company's rapid growth. ElevenLabs was founded by Mat

Hume AI, a startup focused on emotional intelligent voice interfaces, has recently launched an experimental feature called 'Voice Control.' This new tool is designed to help developers and users create personalized AI voices without any coding, AI prompt engineering, or sound design skills. Users can easily customize voices to meet their needs by precisely adjusting voice characteristics. This new feature builds on the company's previously launched 'Empathetic Voice Interface 2' (EVI2), which enhances the naturalness of speech.

ElevenLabs is a startup focused on AI voice cloning and text-to-speech APIs, recently announcing a new feature that allows users to build complete conversational AI agents. Users can now customize various parameters of the conversational agent, such as voice tone and response length, according to their needs on ElevenLabs' developer platform. Previously, ElevenLabs mainly offered various voice and text-to-speech services. The company's growth director, Sam Sklar, stated that...

According to AI media outlet 'Digital Life Kazek', WeChat Official Accounts have quietly rolled out a new feature - AI Voice Cloning, aimed at enhancing users' reading experience. This update is reflected in version 2.29.1 of the official accounts, allowing users to read articles in their own voice, greatly enhancing content personalization. Users can find the 'Reading Voice' option in the backend settings to create their own unique voice. The process of creating a voice is relatively simple; users just need to read a piece of text on the spot, and the system will quickly perform voice cloning.

Recently, Oute AI released a novel text-to-speech synthesis method called OuteTTS-0.1-350M. This method utilizes pure language modeling without the need for external adapters or complex architectures, offering a simplified TTS approach. OuteTTS-0.1-350M is based on the LLaMa architecture, using WavTokenizer to directly generate audio tokens, making the process more efficient. The model features zero-shot voice cloning capability, requiring only a few seconds of reference audio.

Recently, a shocking case of AI voice cloning fraud has drawn widespread attention, highlighting the significant risks associated with this technology. Jay Shuster, a well-known consumer protection lawyer, nearly fell victim to this high-tech scam when the fraudster used AI to imitate Jay's voice, claiming he had been arrested for drunk driving and urgently needed $30,000 in 'bail money.' Astonishingly, the scammer was able to create a convincing voice clone using just 15 seconds of TV interview audio. Despite Jay having previously warned his family to be cautious of such scams, they still...

In today's rapidly advancing world of artificial intelligence, voice synthesis and transformation technologies are evolving at an extraordinary pace, providing us with incredibly realistic and natural audio experiences. However, these technological advancements also bring potential security risks, particularly as 'voice cloning' technology could be exploited by malicious individuals, threatening personal privacy and social stability. In response to this challenge, the Intelligent System Security Laboratory of Zhejiang University and Tsinghua University have joined forces to launch a revolutionary audio forgery detection framework - SafeEar. This framework not only efficiently detects forged audio but also ensures privacy protection during the detection process.

In today's rapidly advancing technology, speech synthesis technology is also progressing, especially in the field of restoring lost voices. Recently, Google researchers introduced a new technology called 'Zero-shot Voice Transfer' which can be directly integrated with state-of-the-art Text-to-Speech (TTS) systems to help those who have lost their voices due to illness or accidents regain their 'voice memory'. The core of this technology is its 'zero-shot' capability, meaning that we do not need a large number of samples to achieve this.

Amazon has launched the AI Cloning Narrator project aimed at accelerating audiobook production. The project invites narrators to submit recordings to train AI for 'voice cloning'. Narrators can choose to participate in the project voluntarily, including live performances or AI-generated recordings. Audiobooks using AI cloning will be labeled on the product detail page, and narrators will be compensated through a royalty-sharing model, requiring narrator consent for AI cloning use. After beta testing in the U.S., this feature will expand to rights holders, aiming to provide narrators with more creative opportunities and enhance the audiobook market.

D-ID has recently launched AI Video Translate, an innovative AI video translation tool that can translate video content into multiple languages, clone the speaker's voice, and adjust lip movements to ensure that the translated content perfectly matches the visuals. This tool supports batch rendering in 29 languages and features a user-friendly interface, making it easy for anyone to use. Through this technology, D-ID helps clients promote marketing, entertainment, and social media activities globally, saving on localization costs. The launch of this technology is significant for small creators.